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Abstract 

The  primal-dual  method  is  interpreted  as  a  parametric 
linear  programming  method.  Some  variants  and  related  methods, 
such  as  Dantzig’s  self-dual  parametric  method  and  the  linear 
programming  variant  of  Houthakker’s  capacity  method  for  qua¬ 
dratic  programming  are  considered  and  compared. 


1.  INTRODUCTION 

In  a  well-known  paper  by  Dantzig,  Ford,  and  Fulkerson  (2), 
a  method  for  solving  a  linear  programming  problem  was  presented. 
In  effect,  they  gave  a  set  of  rules  which  they  proved  would  lead 
ultimately  to  an  optimal  solution  -  if  one  existed.  In  the 
course  of  presenting  the  specific  rules  of  the  method,  they  gave 
an  interpretation  to  the  algorithm  involving  the  formulation  of 
both  the  primal  and  the  dual  problems.  Here  we  give  an  alterna¬ 
tive  interpretation  of  the  method  leading  to  the  same  set  of 


rules . 
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It  turns  out  that  the  primal-dual  method  can  be  interpreted 
as  a  parametric  method  of  a  very  simple  sort.  In  the  following, 
this  method  is  explained  by  means  of  a  simple  example.  The 
equivalence  with  the  primal-dual  method  is  then  considered  in 
some  detail. 

The  parametric  problem  concerned  is  one  with  a  parametric 
objective  function.  Its  dual  problem  has  a  parametric  right- 
hand  side.  This  problem  may  be  solved  parametrically.  Any 
problem  which  has  an  initial  feasible  solution  can  be  treated  in 
the  same  manner;  the  resulting  method  may  be  called  the  dual 
equivalent  of  the  primal-dual  method.  This  method  is  closely 
related  to  the  linear  programming  variant  of  Houthakker's  ca¬ 
pacity  method  in  its  slmplicial  formulation.  The  latter  method 
can  be  proved  to  be  equivalent  to  Dantzlg's  self-dual  parametric 
method.  These  matters  are  discussed  in  the  last  section. 

2.  A  PARAMETRIC  METHOD  FOR  LINEAR  PROGRAMMING 
We  consider  the  following  linear  programming  problem.  Mini¬ 
mise 

(2.1)  f  -  c’x 
subject  to 

(2.2)  Ax  -  b 

(2.3)  x  >  0 

c  and  x  are  column  vettors  of  n  elements,  b  is  a  column  vector 

of  m  elements  and  A  is  an  m  x  n  matrix;  the  symbol  '  denotes 

transposition.  We  assume  that  the  elements  of  b  and  c  are  non- 
1 

negative.  We  also  assume  that  there  is  at  least  one  feasible 

- 1 - - - 

For  cases  in  which  the  elements  of  c  are  not  nonnegative, 
see  Dar.tzig,  Ford  and  Fulkerson  (2)  or  Dantzlg  (1).  There  it  is 
proposed  to  add  an  "artificial  constraint"  ©*x  <  e  for  a  large 
unspecified  value  of  6  and  to  generate  a  feasible  solution  to 
the  dual  problem. 


-3- 


solution  to  the  constraints  (2.2),  (2.3). 

Let  us  also  consider  the  following  related  problem  which  we 
shall  call  the  extended  problem.  Minimize 
(2.ll)  f*  *  c'x  +  Xe'y 

subject  to 

(2.5)  Ax  +  y  ■  b, 

(2.6)  x,  y  2  0, 

y  is  a  column  vector  of  m  artificial  variables,  e  is  a  vector  of 
m  elements  which  are  all  unity  and  X  is  a  variable  parameter. 

For  a  sufficiently  high  value  of  x,  the  solution  of  the 
extended  problem  must  be  the  same  as  that  of  the  original  prob¬ 
lem,  because  such  a  value  of  X  will  prevent  the  y-variables  from 
having  nonzero  values.  On  this,  the  usual  two-phase  method  for 
linear  programming  is  based.  The  extended  problem  with  X  having 
a  very  high  value  is  solved  instead  of  the  original  problem  with 
an  initial  basic  solution  y  ■  b.  This  amounts  to  minimizing 
first  the  objective  function 

(2.7)  e'y  ■  Ey, 

since  the  terms  in  X  are  dominant;  this  leads  to  a  feasible  so¬ 
lution  of  the  original  problem,  after  which  the  original  objec¬ 
tive  function  can  be  used  to  find  the  optimal  solution. 

The  following  parametric  method  also  uses  the  extended  prob¬ 
lem,  but  Instead  of  solving  t ne  problem  immediately  for  a  high 
value  of  x,  we  solve  the  problem  first  for  X  -  0,  after  which  X 
is  Increased  parametrically.  The  initial  basic  feasible  solution 
y  >  b  is  x  *  0  also  an  optimal  solution,  since  all  elements  of  c 
are  assumed  to  be  nonnegative.  After  that,  parametric  linear 
programming  (see  Qass  and  Saaty  (3)) is  used  to  trace  the  optimal 


solutions  of  the  extended  problem  for  increasing  values  of  X. 

The  solution  for  X  •  must  be  the  optimal  solution  of  the  ori¬ 
ginal  problem. 

This  parametric  method  is  equivalent  to  the  primal-dual 
method  in  the  sense  that  its  computational  rules  are  the  same; 
it  can  therefore  be  viewed  as  an  alternate  interpretation  of  th~ 
primal-dual  method.  First  an  example  of  application  of  this 
parametric  method  will  be  given.  In  the  next  section,  this  ex¬ 
ample  will  be  used  to  explain  the  equivalence. 

As  an  example,  we  take  the  problem  used  by  Dantzig  (1)  for 
the  primal-dual  method.  Minimize 

(2.3)  f  -  x  ♦  iix_  +  8x_  +  8x.,  t  23xc 

1  *  3  *«  b 


subject  to 
(2.9) 


( 

( 


♦  4x2  -  5x^  ♦  7xjj  *•  ^x5 

-  JlXg  ♦  ^  -  ^Xjj  + 

X2  -  3X3  +  4x4  -  2x5 


«  8, 
■  2, 
-  2, 


(2.10)  x1#  x2,  X3,  x^,  x^  >  0. 

In  the  formulation  of  the  extended  problem,  the  terms 

Xy  +  Xy  ♦  Xy 
12  3 

are  added  to  the  objective  function  and  y^,  y2  and  y^  are  added 
to  the  left  side  of  the  respective  equations  of  (2.9).  The  ini¬ 
tial  basic  solution  is  then  y^  *  8,  y2  ■  2  and  y^  «  2  and  the 
corresponding  initial  tableau  is  obtained  by  subtracting  x  times 
the  equality  conftraints  of  the  extended  problem  from  its  objec¬ 
tive  function.  This  objective  function  becomes  then 

(2.11)  f#  ■  x^  ♦  l*x2  +  8x^  +  8x4  +  2 3x^ 

♦  X ( -  12  -  x^  -  x2  +  4x^  -  7xj,  +  2x^) . 
Putting  the  X  terms  in  a  separate  row,  the  initial  tableau  as 
given  in  Tableau  0  of  Table  1  is  obtained;  the  value  of  the 
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terms  without  X  is  indicated  by  f,  that  of  the  terms  with  X  by 
w.  Adding  to  the  f-row  x  times,  the  w-row  for  specific  values 
of  X,  a  row  is  obtained  which  represents  the  objective  function 
for  specific  values  of  x. 

In  Tableau  0  of  Table  1,  the  specific  value  of  X  is  first 
taken  to  be  0.  For  this  value,  the  initial  solution  is  also  an 
optimal  solution  of  the  extended  problem,  since  all  coefficients 
in  the  row  -f*(0)  are  non-negative.  Next,  consider  for  what 
range  of  X  the  present  solution  is  an  optimal  one.  Its  upper 
bound  is  determined  by 


(2.12) 


Min  /  f 

1  I  -i 


"l  < 


» 


where  f^  stands  for  the  element  in  the  f-row  and  in  the  i-th 
column  and  w^  'or  the  element  in  the  w-row  and  in  the  same 
column.  In  Tableau  0,  it  turns  out  that  the  highest  value  of  x 
for  which  the  solution  is  optimal  is  1,  because  for  that  value 
the  coefficient  of  x^  in  the  objective  function,  becomes  zero. 
The  row  -f*(l)  gives  then  the  value  of  the  objective  function 
for  X  ■  1.  According  to  the  usual  parametric  procedure,  x1 
enters  the  basis  and  y leaves  it.  Tableau  0  is  then  trans¬ 
formed  into  Tableau  1.  Note  that  the  value  of  w  has  decreased, 
as  it  should,  because  a  variable  having  a  negative  coefficient 
in  the  w-row  entered  the  basis.  The  column  of  y^  which  is  now 
a  nonbasic  variable  is  deleted  because  we  do  not  wish  y^  to 
re-enter  the  basis. 

The  solution  of  Tableau  1  is  optimal  for  X  ■  1.  An  upper 
bound  on  X  for  which  this  solution  is  optimal  is  found  by  apply¬ 
ing  (2.12)  again;  this  upper  bound  turns  out  to  be  x  *  13. 


table  i.  simplex  tableaux  for  example 
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x^  must  then  enter  the  basis  and  y2  leaves  it;  the  column  of 
y2  is  deleted  in  the  resulting  tableau. 

In  Tableau  2,  it  turns  out  that  the  minimum  in  (2.12)  is 
not  unique,  because  the  coefficients  of  and  x^  in  the  f*-row 
both  vanish  for  X  *  14.  This  is  a  degenerate  solution,  but  it 
causes  no  difficulty  because  whichever  variable  enters  into  the 
basis,  the  value  of  w  decreases.  Hence,  either  variable  may 
enter  the  basis.  Choosing  x^,  we  find  that  y^  must  leave  the 
basis.  The  solution  of  the  resulting  tableau  is  found  to  be 
the  optimal  solution,  since  w  haa  a  zero  value.  This  optimal 
solution  is  not  unique  because  the  coefficient  of  f  Jn  the 
column  of  x^  is  zero.  The  corresponding  extreme-point  optimal 
solution  is  generated  in  Tableau  <J. 


3.  EQUIVALENCE  WITH  THE  PRIMAL-DUAL  f-ETHOD 


The  primal-dual  method  starts  with  a  feasible  solution  to 
the  dual  of  the  original  problem.  The  general  lorm  of  this 
dual  problem  is,  see  (2.1) -(2. 3): 

Maximize 

(3.1)  b'u 
subject  to 

(3.2)  A'u  <  c. 

u  is  a  column  vector  of  m  elements.  Introducing  a  vector  v  of 
n  slack  variables,  the  constraint  (3.2)  can  be  written  as 

(3.3)  A'u  +  v  <  c, 

O.1*)  v  >  0. 

Because  it  was  assumed  that  the  elements  of  c  are  nonnegative, 
an  Initial  feasible  solution  is  v  *  c,  u  *  0.  However,  this 


-8- 


solution  is  not  likely  to  be  an  optimal  one,  since  all  elements 
of  b  are  nonnegative. 

We  consider  also  the  primal  feasibility  problem:  Minimize 

(3.5)  e'y 

pub J ret  to 

(3.6)  Ax  +  y  ■  b, 

(3.7)  x,  y  >  0, 

and  its  dual:  Maximize 

(3.8)  b'u* 
subject  to 

(3.9)  A’u*  <  0, 

(3.10)  u»  <  e. 

Constraint  (3.9)  can  be  written  as 

(3.11)  A'u#  +  v«  «  0, 

(3.12)  v»  >  0. 

The  primal-dual  method  is  based  on  the  following  ideas. 

An  initial  solution  of  the  dual  problem  (3-1)— (3.2)  is  avail¬ 
able.  Suppose  there  are  some  vectors  u*,  v*  which  give  a 
positive  value  of  the  objective  function  of  the  dual  feasibility 
problem;  for  this  latter  solution,  (3.12)  need  not  be  satisfied. 
If  the  first  solution  is  u,  v,  and  the  second  u*,  v*,  then  the 
solution 


(3.13)  u  +  ku*,  v  kv* 

must  give  a  higher  value  of  the  objective  function  of  the  dual 
problem  for  k  >  0,  since  b*u#  was  assumed  to  be  positive.  How¬ 
ever,  v*  was  not  necessarily  positive,  so  that  for  some  value 

of  k  £  0,  v  ♦  kv*  might  become  negative.  Hence  we  determine 

/  r: 

,  ,  x  r  Min  /  vi 

1  ^ 
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If  this  value  of  k  Is  used  In  (3.13),  the  objective  function  of 
the  dual  is  increased  as  much  as  possible  without  making  its 
solution  infeasible.  After  this,  a  new  solution  to  the  dual 
feasibility  problem  is  generated  and  added  to  the  solution  of 
the  dual  in  the  same  manner  as  before.  The  dual  objective 
function  is  increased  until  no  Improvement  is  possible  because 
the  objective  function  of  the  dual  feasibility  problem  has  be¬ 
come  zero.  The  optimal  solution  of  the  dual  problem  has  then 
been  obtained. 

The  solutions  of  the  dual  feasibility  problem  are  obtained 
via  the  primal  feasibility  problem;  the  dual  variables  appear 
then  in  the  row  of  the  objective  function.  The  method  starts 
usually  with  a  solution  of  the  dual  problem  v  »  c,  u  ■  0, 
which  is  a  feasible  solution.  For  the  primal  feasibility 
problem,  the  solution  y  ■  b,  x  «  0  is  taken.  The  corresponding 
basic  solution  of  the  dual  feasibility  problem  is 
(3.15)  u*  ■  e,  v*  «  -/\'u*  «  -A'e; 

the  value  of  its  objective  function  is  b’e  which  is  positive 
if  b  has  at  least  one  positive  element.  Adding  a  multiple  k 
determined  by  (3. 1*0  of  the  solution  (3.15)  to  that  of  the  dual 
problem,  we  find  that  the  objective  function  of  the  dual  prob¬ 
lem  is  Increased  for  k  +  0;  k  ■  0  can  only  occur  if  some  basic 
v-variables  are  zero  for  corresponding  negative  v#-variables. 
This  can  only  occur  in  the  first  iteration,  because  there  are 
some  additional  requirements  for  solutions  of  the  feasibility 
problem  in  later  Iterations.  These  are,  given  the  improved 
solution  of  the  dual  problem,  a  restricted  primal  infeasibility 


problem  is  solved,  in  which  the  variables  to  enter  the  basis 
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are  restricted  to  those  which  have  zero  corresponding  variables 
in  the  dual  problem.  These  will  be  the  basic  variables  and  the 
variable  connected  with  k  In  (3.1*0;  if  the  minimum  was  not 
unique,  then  all  the  variables  connected  with  this  minimum  art 
Included  plus  possible  other  variables  connected  with  zero  v- 
varlables.  The  optimal  solution  to  this  restricted  primal 
feasibility  problem  is  one  with  v*-variables  of  the  correspond¬ 
ing  dual  which  are  nonnegative  for  v-variables  which  are  zero. 
Hence  when  we  next  add  the  solution  of  the  corresponding  dual 
feasibility  problem  to  the  dual  solution,  k  is  nonzero.  After 
this,  another  restricted  primal  feasibility  problem  is  solved 
and  so  on,  until  tLe  objective  function  of  the  feasibility 
problem  has  become  zero;  in  that  case  the  optimal  solution  of 
the  dual  problem  has  been  found,  and  also  the  solution  of  the 
original  problem. 

Let  us  now  compare  the  primal-dual  method  with  the  para¬ 
metric  approach  using  the  numerical  example  presented  in  the 
previous  section.  Tableau  0  of  Table  1  gives  the  initial  so¬ 
lution  of  the  primal  feasibility  problem;  the  w-row  gives  the 
value  of  its  objective  function  and  the  values  of  the  basic 
variables  of  the  corresponding  dual  solution.  Hence  we  have 

vj  «  -1,  v«  •  -1,  v»  ■  4,  v*  *  -7,  v5  *  2. 

The  f-row  now  gives  the  values  of  the  objective  function  of 
the  original  dual  problem  and  its  corresponding  solution.  The 
solution  of  the  dual  problem  is 

v  »  1,  v  «  4,  v  ■  8,  v  *  8,  v  *  23. 

1  2  3  *»  5 

Now  k  times  the  w-row  is  added  to  the  f-row,  thus  increasing 
the  objective  function  of  the  dual  from  0  to  12k.  The  maximum 
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value  of  k  turns  out  to  be  1;  the  row  -f*(l)  gives  the  improved 
value  of  the  objective  function  of  the  dual  as  well  as  the  cor¬ 
responding  solution  of  the  dual.  According  to  the  parametric 
procedure,  must  enter  the  basis.  The  same  is  true  for  the 
primal-dual  method,  since  in  the  restricted  primal  feasibility 
problem  only  and  the  basic  variables  may  be  in  the  basis. 

In  the  resulting  transformation  both  methods  transform  the  row? 
of  basic  variables  and  the  w-row  in  the  same  way;  the  primal- 
dual  method  has  no  f-row  and  it  does  not  transform  the  present 
solution  of  the  dual  problem.  The  parametric  procedure  trans¬ 
forms  the  f-row  or  -f*(l)-row,  but  this  last  row  does  not 
change  since  its  element  in  the  x^-column  is  zero. 

In  the  next  tableau  the  primal-dual  method  adds  k  times 
the  w-row  to  the  f*(l).  k  is  then  found  to  be  12  and  is  con¬ 
nected  with  x^.  The  parametric  procedure  adds  A  times  the 
w-rows  to  the  f-row  and  finds  A  *  12,  connected  with  x^.  The 
result,  the  row  indicated  by  — r* (13)  is,  in  both  cases,  the 
same.  As  is  easily  seen,  k  is  equal  to  the  increase  in  a. 

Each  cycle  in  the  primal-dual  method  corresponds  with  a 
particular  value  of  A  in  the  parametric  approach.  The  restrict¬ 
ed  columns  of  the  primal  feasibility  problem  are  the  same  as 
the  columns  which  have  the  same  ratio  A  of  elements  in  the 
f-  and  the  w-row.  Usually  the  optimal  solution  to  the  restrict¬ 
ed  primal  feasibility  problem  will  be  obtained  in  one  iteration, 
but  it  is  possible  that  it  takes  more  iterations.  This  can 
be  the  case  when  the  maximum  from  which  k  or  A  is  found  Is  not 

m 

unique.  The  adjusted  dual  solution  contains  then  more  than 
one  zero  apart  from  the  basic  variables.  An  example  of  this 
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can  be  found  In  Tableau  2,  where  both  x  and  x  are  connected 

4  5 

with  the  minimum  in  (3*1*0  •  x.  and  x_  are  then  both  columns  of 

q  5 

the  restricted  primal  feasibility  problem  and  if  x_  is  chosen 

y 

as  a  basic  variable  instead  of  x^,  it  takes  two  iterations  to 
obtain  the  solution  of  the  restricted  problem.  Again  there  is 
no  substantial  difference  with  the  parametric  procedure. 

Hence  it  may  be  concluded  that  both  procedures  are  equiv¬ 
alent  and  differ  only  by  having  k  in  the  primal-dual  method 
which  is  equal  to  the  increment  of  x  used  in  the  parametric 
method.  The  two  methods  may  therefore  be  seen  as  two  alter¬ 
native  interpretations  of  the  same  algorithm. 

4.  VARIANTS  AND  RELATED  PARAMETRIC  METHODS 

The  dual  of  the  extended  problem  is  as  follows.  Maximise 

(4.1)  f  *  b’u 
subject  to 

(4.2)  A'u  <  c , 

(4.3)  u  <  Xe. 

The  last  set  of  constraints  does  not  occur  In  the  original 
problem  but  corresponds  to  the  artificial  variables  in  the 
extended  problem. 

Each  method  for  the  primal  linear  programming  problem  has 
its  equivalent  method  for  the  dual  problem;  for  instance,  the 
dual  method  for  the  primal  problem  is  equivalent  to  the  Simplex 
method  for  the  dual  problem.  We  shall  now  indicate  the  equiv¬ 
alent  method  of  the  parametric  method  described  in  Section  2. 

The  initial  tableau  can  be  obtained  as  follows.  The 
constraints  (4.2)  and  (4.3)  can  be  written  as  equations  by 
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means  of  the  Introduction  of  the  vectors  of  slack  variables 
v  and  z : 

(4.1*)  A*u  +  v  c, 

(4.5)  u  +  r  -*  xe, 

(4.6)  v,  z  >  0. 

Putting  the  equations  (4.1),  (4.4)  and  (4.5)  Into  tableau 
format,  we  obtain  the  set-up  tableau  given  In  Table  2;  the 
values  of  basic  variables  are  separated  Into  a  constant  term 
and  a  term  dependent  on  X .  In  the  equivalent  primal  method  the 
y-variables  were  basic  and  the  x-variables  nonbaslc  In  the 
Initial  solution.  In  the  dual  equivalent  the  z-variables  must 
therefore  be  nonbaslc  and  the  v-variables  basic;  the  u-varlablec 
must  be  basic  because  there  are  no  slack  variables  in  the 
primal  problem.  This  initial  solution  and  its  corresponding 
tableaux  are  generated  by  block-pivoting  on  the  underlined 
matrix  I  in  the  set-up  tableau  in  order  to  introduce  the  u- 
variables  in  the  basis,  replac4,~~  the  z-variables.  After  the 
u-variables  have  entered  the  basis,  their  r^ws  may  be  deleted, 
because  the  u-variables  are  unrestricted. 

TABLE  2.  SET-UP  AND  INITIAL  TABLEAU  FOR  EQUIVALENT  DUAL  METHOD 


Bas . 

Var . 

Val . 

3. Var . 

u 

V 

z 

f 

C.t 

X-t 

Set-Up 

V 

c 

0 

A* 

I 

0 

0 

Tabl . 

z 

0 

e 

I 

0 

I 

0 

f 

0 

0 

-b' 

0 

0 

1 

Init . 

V 

c 

-A'e 

0 

I 

-A’ 

0 

Tabl. 

u 

0 

e 

I 

0 

I 

0 

f 

0 

b’e 

0 

0 

b’ 

1 
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The  Initial  solution  is  optimal  for  x  *  0  since  b  ard  c 
are  both  nonnegative.  After  this,  x  is  increased  parametrically 
until  X  *►  •.  This  method  is  completely  equivalent  to  the 
primal-dual  method. 

The  dual  equivalent  of  the  primal-dual  method  may  be 
applied  to  any  linear  programming  problem  with  an  Initial 
feasible  solution.  Consider  the  following  problem.  Maximize 
(4.7)  f  «  c ' x 


subject  to 

(4.8)  Ax  <  b, 

M 

(«.9)  X  >  0. 

m 

We  assume  that  both  b  and  c  are  nonnegative.  Adding  the 
"artificial  constraint" 

(4.10)  x  <  Xe, 

we  find  that  the  problem  has  the  same  form  as  (4.1)  -  (4.3) 
apart  from  the  fact  that  the  x-variable3  are  restricted.  The 
same  method  may  now  be  applied.  Table  3  gives  the  6et-up  and 
initial  tableaux  of  this  method  which  may  be  called  the  dual 
equivalent  of  the  primal-dual  method. 

Let  us  consider  an  application  of  this  method  to  the 
following  small  problem.  Maximize 

(4.11)  f  «  ♦  4x2 

subject  to 


(4.12) 

(4.13) 

(4.14) 


+  2x 

2 


i 2- 

i  i. 


x  ,  x  >  0. 
1  2  - 
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TABLE  3.  SET-UP  AND  INITIAL  TABLEAU  FOR  THE  DUAL 
EQUIVALENT  OF  THE  PRIMAL-DUAL  METHOD 


Ba  s . 

Val .  B 

Var. 

■n 

Var. 

HI 

m 

B 

B 

z 

f 

y 

b 

0 

A 

H 

0 

m 

Set-Up 

z 

0 

e 

I 

c 

I 

0 

Tableau 

f 

0 

0 

-c  * 

0 

0 

■ 

y 

b 

-Ae 

0 

i 

m 

0 

Init . 

X 

0 

e 

I 

0 

I 

1 

Tableau 

f 

0 

c '  e 

0 

0 

c' 

M 

.-1 
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Table  4  gives  the  successive  solutions  of  the  method. 
Tableau  0  is  constructed  in  accordance  with  the  initial  tableau 
of  Table  3.  The  critical  value  of  A  is  found  to  be  1;  a4'  this 
value  y^  has  to  leave  the  basis.  Dual  feasibility  requires 
then  that  should  enter  the  basis.  The  next  critical  value 
of  A  is  4;  hence  y^  should  leave  the  basis  and  it  is  found 
that  z^  enters  it.  In  Tableau  2  no  critical  value  of  X  can  be 
found,  so  that  the  optimal  solution  must  have  been  found.  Not 
all  rows  given  in  Table  4  are  needed;  the  rows  of  the  basic 
z-variables  can  be  deleted;  furthermore,  the  rows  of  basic 
x-variables  with  corresponding  nonbasic  z-variables  are  always 
the  same  so  that  they  do  not  have  to  be  written  down. 

Instead  of  adding  an  "artificial  constraint"  for  each 
variable  as  in  (4.10),  we  may  Just  add  one  "artificial  con¬ 
straint"  on  the  sum  of  the  variables, 

(4.15)  e'x  <  X. 

An  initial  feasible  and  optimal  solution  for  X  *  0  is  then 
found  by  introducing  into  the  basis  in  the  set-up  tableau  based 
on  (4.7),  (4.8)  and  (4.15),  the  variable  with  the  largest 
c-coefflcient,  replacing  the  slack  variable  of  (4.15).  After 
this,  x  is  varied  parametrically  until  A  *.  Table  5  gives 
an  application  of  this  method  to  the  problem  (4.11)  -  (4.14). 
This  procedure  can  be  considered  as  a  variant  of  Houthakker's 
capacity  method  for  quadratic  programming  (4).  For  details, 
see  van  de  Panne  and  Whinston  (5). 
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TABLE  H.  APPLICATION  OF  THE  DUAL  EQUIVALENT 
OF  THE  PRIMAL-DUAL  METHOD 
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TABLE  5.  APPLICATION  OP  THE  CAPACITY  METHOD 
TO  A  LINEAR  PROGRAMMING  PROBLEM 


Tabl. 

Bas .V. 

mm 

B 

X2 

Tabl. 

Bas .V. 

Ind . t . 

D 

D 

E 

tam 

ECL9 

*1 

2 

n 

B 

2 

xi 

-2/3 

2/3 

-1/3 

2/3 

0 

y2 

1 

i 

1 

H 

2 

y2 

2  1/3 

-1/3 

2/3 

4/3 

y3 

0 

B 

X2 

2/3 

1/3 

1/3 

1/3 

f 

0 

-3 

i 

f 

2/3 

31/3 

1/3 

3  h 

m 

y3 

*1 

y2 

Hi 

H 

-2 

-3 

-2 

X1 

4 

0 

H 

2 

1 

y2 

B 

1 

2 

1 

3 

y3 

-7 

1 

-2 

-3 

X2 

0 

1 

1 

1 

x2 

3 

0 

1 

1 

f 

4 

1 

4 

f 

24 

0 

_ 1 

7 

10 

A  method  which  Is  related  to  the  above  approach  is  Dantzig 
self-dual  parametric  method.2  First  we  shall  deal  with  the 
special  cane  in  which  the  problem  has  the  form  (4.7)  -  (4.9) 
with  b  aonnegatlve,  and  the  elements  of  c  positive.  The  fol¬ 
lowing  objective  function  is  then  used: 

(4.16)  f  ■  (c  -  xe) 'x. 

For 

(4.17)  x  i  Max  c. , 

the  initial  solution  in  which  the  slack  variables  of  (4.8)  are 
basic  is  feasible  and  optimal.  A  parametric  procedure  is  then 
used  to  decrease  X  until  an  optimal  solution  is  found  for  x  ■  0 
this  is  then  the  solution  of  the  original  problem. 

^See  Dantzig  (l)  pp.  245  -  247. 
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TABLE  6.  APPLICATION  OP  DANTZIO'S 
SELF-DUAL  PARAMETRIC  METHOD 


Tabl. 

Bas.V. 

V.B.V. 

D 

E9 

2 

-i 

B 

0 

*2 

1 

B 

B 

f(x) 

0 

B 

B 

f(c) 

0 

-3 

B 

B 

*i 

x2 

1 

-*i 

B 

1 

*2 

2 

s 

B 

f(x) 

-1 

1*1 

B 

f(c) 

4 

-5 

2 

*2 

*2 

3 

B 

B 

2 

X1 

4 

2 

H 

f(x) 

-7 

-3 

-2 

f(c) 

24 

B 

Table  6  gives  the  iterations  for  an  application  of  this 
method  to  the  problem  (4.11)  -  (4.14).  The  first  critical 
value  of  x  turns  out  to  be  4,  the  second  3  */3;  after  the 
second  iteration  the  optimal  solution  has  been  found. 

For  problems  with  all  elements  of  b  nonnegative  and  those 


of  c  positive  the  self-dual  parametric  method  is  equivalent 
to  the  capacity  method  for  linear  programming  in  the  sense  th?t 
it  gener  tes  the  same  sequence  of  solutions  which,  however. 
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differ  in  some  respects.  In  the  capacity  method  the  slack 
variable  of  the  capacity  constraint  will  be  nonbasic  in  a?l 
tableaux  except  the  first  and  last  ones,  whereas  it  may  be 
considered  as  a  basic  variable  in  the  parametric  method.  A 
further  difference  is  that  the  variable  which  in  a  certain 
iteration  leaves  the  basis  in  the  self-dual  parametric  iter¬ 
ation,  leaves  the  basis  in  the  capacity  method  in  the  cor¬ 
responding  next  iteration;  y^^  leaves  the  basis  in  the  first 
Iteration  in  the  capacity  method  (see  Tableau  0  of  Table  6), 
while  in  the  capacity  method  it  leaves  the  basis  in  the  second 
iteration  (see  Tableau  1  of  Table  5). 

The  equivalence  of  bot*  methods  can  be  proved  by  induction 
as  follows.  In  the  first  iteration  the  same  variable  enters 
the  basis  in  both  methods.  In  the  capacity  method  y  ,  the 

A 

slack  variable  of  the  capacity  constraint,  leaves  the  basis, 
while  in  the  parametric  method  an  ordinary  basic  variable 
leaves  the  basis. 

Consider  any  tableau  generated  by  the  parametric  method. 

A  representation  of  such  a  tableau  is  given  in  the  first 
tableau  of  Table  7;  stands  for  a  typical  basic  variable. 


which  left  the  basis  in  the  last  iteration.  The  corresponding 
tableau  for  the  capacity  method  can  be  generated  from  this 
tableau  by  introducing  x^  into  the  basis,  replacing  f^  as  a 
basic  variable.  The  resulting  tableau  is  then  the  second  one 
of  Table  7.  We  shall  now  check  whether  the  variables  to 
leave  and  to  enter  the  basis  are  the  same  in  both  methods.  In 
the  capacity  method  the  variable  to  leave  the  oasis  is  deter- 
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ralned  by 


(4.18) 


f  _i  -1 

Min  j  bl  ~  al,jdj  d0  ,  dJ  d0  -aj  d"1  <  0 


aUdj 


UJ  u0 


U  J 


TABLE  7.  EQUIVALENCE  OF  SELF-DUAL  PARAMETRIC 
AND  CAPACITY  METHOD 


dJldo  Oj1 

fc  °0-cJdj'ldO 


alk**alJdJ  dk 


dj\ 


0  •  VejdJdk  • 


Since  dj  <  0  because  left  the  basis,  this  may  be  rewritten 


(4.19) 


Min  ;  -d0  ♦  ,  -d0  a  <  0 

1  a4  .  i 


It  is  then  obvious  that  the  term  behind  the  comma  is  connected 
with  the  minimum  so  that  leaves  the  basis,  which  is  as  it 
should  be. 


AI30  the  variable  to  enter  the  basis  is  the  same.  In 
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the  parametric  method  it  is  determined  by 


0.20) 


Min 

k 


(  ck 

I  a~ 


» 


while  in  the  capacity  method  it  is  given  by 


0.21) 


Min 

k 


-dj\ 


d 


k 


» 


which  can  be  rewritten  as 


for  dj  <  0  this  is  the  same  as  (4.20). 

In  his  self-dual  parametric  method  Dantzlg  adds  terms  in 
X  only  to  x-variables  which  have  positive  coefficients  in  the 
objective  function,  while  Houthakker  includes  all  x-varlables 
in  this  capacity  constraint.  This  difference  is  a  rather 
superficial  one,  since  in  the  parametric  method  terms  in  X  may 
be  added  to  the  coefficients  of  all  x-variables  regardless  of 
sign,  while  on  the  other  hand,  in  the  capacity  method  x-var- 
lables  may  be  deleted  from  the  capacity  constraint  if  they  have 
nonpositive  coefficients  in  the  objective  function. 

The  main  feature  of  the  self-dual  parametric  method  is, 
of  course,  that  if  a  solution  is  neither  prlmally  nor  dually 
feasible,  terms  in  X  may  also  be  added  to  the  values  of  basic 
variables  in  order  to  make  this  solution  feasible;  hence  if  all 
elements  of  b  are  negative,  b  is  replaced  by 


(4.23) 


b  +  Xe ; 


in  case  only  some  elements  of  b  are  negative  we  have  instead 
of  e  a  vector  with  unit  elements  corresponding  with  negative 
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elements  of  b  and  zeros  elsewhere.  A  parametric  decrease  in 
X  affects  then  also  primal  feasibility  and  the  method  may 
involve  primal  as  well  as  dual  Iterations. 

A  corresponding  capacity  method  can  be  constructed  as 
follows.  Consider  the  following  problem.  Maximize 


(4.24) 

f  ■  C ' X  -  xxx 

subject  to 

(4.25) 

Ax  -  ex^  +  y  * 

b. 

(4.26) 

e’x  +  yx= 

A, 

(4.27) 

x,  xx,  y,  yx  > 

0. 

Instead  of  the  e-vectors  we  may  again  have  vectors  with  unit 
elements  only  for  negative  elements  of  b  and  positive  ones  of 
c.  is  here  an  artificial  variable  corresponding  with  a  dual 
capacity  constraint 
(4.28)  e’u  <  x  . 

In  the  first  iteration  the  x-variable  corresponding  with  the 
largest  nositive  element  of  c  is  introduced  into  the  basis, 
replacing  yx;  in  the  second  one,  xx  enters  the  basis,  replac¬ 
ing  the  y-variable  corresponding  with  the  largest  (in  absolute 
value)  negative  element  of  b.  After  this,  X  is  increased 
parametrically  in  the  usual  fashion. 

Comparing  this  version  of  the  capacity  method  with  the 
self-dual  parametric  method,  it  is  found  that  the  latter 
method  is  simpler,  because  its  tableaux  have  one  column  and 
one  row  less,  while  furthermore  the  capacity  method  requires 
no  extra  iterations.  The  self-dual  parametric  method  should 
therefore  be  preferred  to  the  capacity  method. 
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